AutoParallel: A Python module for automatic parallelization and distributed execution of affine loop nests

The last improvements in programming languages, programming models, and frameworks have focused on abstracting the users from many programming issues. Among others, recent programming frameworks include simpler syntax, automatic memory management and garbage collection, which simplifies code re-usage through library packages, and easily configurable tools for deployment. For instance, Python has risen to the top of the list of the programming languages due to the simplicity of its syntax, while still achieving a good performance even being an interpreted language. Moreover, the community has helped to develop a large number of libraries and modules, tuning them to obtain great performance. However, there is still room for improvement when preventing users from dealing directly with distributed and parallel computing issues. This paper proposes and evaluates AutoParallel, a Python module to automatically find an appropriate task-based parallelization of affine loop nests to execute them in parallel in a distributed computing infrastructure. This parallelization can also include the building of data blocks to increase task granularity in order to achieve a good execution performance. Moreover, AutoParallel is based on sequential programming and only contains a small annotation in the form of a Python decorator so that anyone with little programming skills can scale up an application to hundreds of cores.Comment: Accepted to the 8th Workshop on Python for High-Performance and Scientific Computing (PyHPC 2018

Transparent Orchestration of Task-based Parallel Applications in Containers Platforms

This paper presents a framework to easily build and execute parallel applications in container-based distributed computing platforms in a user-transparent way. The proposed framework is a combination of the COMP Superscalar (COMPSs) programming model and runtime, which provides a straightforward way to develop task-based parallel applications from sequential codes, and containers management platforms that ease the deployment of applications in computing environments (as Docker, Mesos or Singularity). This framework provides scientists and developers with an easy way to implement parallel distributed applications and deploy them in a one-click fashion. We have built a prototype which integrates COMPSs with different containers engines in different scenarios: i) a Docker cluster, ii) a Mesos cluster, and iii) Singularity in an HPC cluster. We have evaluated the overhead in the building phase, deployment and execution of two benchmark applications compared to a Cloud testbed based on KVM and OpenStack and to the usage of bare metal nodes. We have observed an important gain in comparison to cloud environments during the building and deployment phases. This enables better adaptation of resources with respect to the computational load. In contrast, we detected an extra overhead during the execution, which is mainly due to the multi-host Docker networking.This work is partly supported by the Spanish Government through Programa Severo Ochoa (SEV-2015-0493), by the Spanish Ministry of Science and Technology through TIN2015-65316 project, by the Generalitat de Catalunya under contracts 2014-SGR-1051 and 2014-SGR-1272, and by the European Union through the Horizon 2020 research and innovation program under grant 690116 (EUBra-BIGSEA Project). Results presented in this paper were obtained using the Chameleon testbed supported by the National Science Foundation.Peer ReviewedPostprint (author's final draft

Electrospray Ionization Based Methods for the Generation of Polynuclear Oxo- and Hydroxo Group 6 Anions in the Gas-Phase

Electrospray ionization (ESI) of the Lindqvist (n-Bu4N)2[M6O19] (M = Mo, W) polioxometalates provides a straightforward entry for the generation of an assortment of oxo- and hydroxo anions in the gas-phase. In particular, the series of oxo dianions of general formula [(MO3)nO]2- (n = 2-6; M = Mo, W), monoanions, namely [(MO3)nO]- (n = 1, 2) and [(MO3)n]- (n = 1, 2), and the hydroxo [(MO3)n(OH)]- (n = 1-6) species can be readily generated in the gas-phase upon varying the solvent composition as well as the ionisation conditions (typically the Uc cone voltage). Complementary tandem mass experiments (collision induced dissociation and ion-molecule reactions) are also used aimed to investigate the consecutive dissociation of these species and their intrinsic gas-phase reactivity towards methanol. Special emphasis is paid to some of the key factors of these group 6 anions related to the gas-phase activation of methanol, such as molecular composition, open vs closed shell electronic nature and cluster siz

Topological Constraints in Eukaryotic Genomes and How They Can Be Exploited to Improve Spatial Models of Chromosomes

Several orders of magnitude typically separate the contour length of eukaryotic chromosomes and the size of the nucleus where they are confined. The ensuing topological constraints can slow down the relaxation dynamics of genomic filaments to the point that mammalian chromosomes are never in equilibrium over a cell's lifetime. In this opinion article, we revisit these out-of-equilibrium effects and discuss how their inclusion in physical models can enhance the spatial reconstructions of interphase eukaryotic genomes from phenomenological constraints collected during interphase.Comment: 5 pages, 1 figure, opinion article, submitted for publicatio

Management Ubiquitous of Messages and Documents Organizational through Intelligent Agents

In the context of artificial intelligence, the multiagent systems are an alternative solution to address complex problems and distributed. PAINALLI is an multi-agent architecture for managing messages and documents organizational anywhere and anytime. To formalize, the management makes use of international standards such as ISO 15489 and MoReq specification. The ubiquity gained in the architecture is due to the use of intelligent agents deployed in fixed and mobile technologies: personal computers, smart phones and personal digital assistants.In the context of artificial intelligence, the multiagent systems are an alternative solution to address complex problems and distributed. PAINALLI is an multi-agent architecture for managing messages and documents organizational anywhere and anytime. To formalize, the management makes use of international standards such as ISO 15489 and MoReq specification. The ubiquity gained in the architecture is due to the use of intelligent agents deployed in fixed and mobile technologies: personal computers, smart phones and personal digital assistants

Management Ubiquitous of Messages and Documents Organizational through Intelligent Agents

In the context of artificial intelligence, the multiagent systems are an alternative solution to address complex problems and distributed. PAINALLI is an multi-agent architecture for managing messages and documents organizational anywhere and anytime. To formalize, the management makes use of international standards such as ISO 15489 and MoReq specification. The ubiquity gained in the architecture is due to the use of intelligent agents deployed in fixed and mobile technologies: personal computers, smart phones and personal digital assistants.In the context of artificial intelligence, the multiagent systems are an alternative solution to address complex problems and distributed. PAINALLI is an multi-agent architecture for managing messages and documents organizational anywhere and anytime. To formalize, the management makes use of international standards such as ISO 15489 and MoReq specification. The ubiquity gained in the architecture is due to the use of intelligent agents deployed in fixed and mobile technologies: personal computers, smart phones and personal digital assistants

Management Ubiquitous of Messages and Documents Organizational through Intelligent Agents

In the context of artificial intelligence, the multiagent systems are an alternative solution to address complex problems and distributed. PAINALLI is an multi-agent architecture for managing messages and documents organizational anywhere and anytime. To formalize, the management makes use of international standards such as ISO 15489 and MoReq specification. The ubiquity gained in the architecture is due to the use of intelligent agents deployed in fixed and mobile technologies: personal computers, smart phones and personal digital assistants.In the context of artificial intelligence, the multiagent systems are an alternative solution to address complex problems and distributed. PAINALLI is an multi-agent architecture for managing messages and documents organizational anywhere and anytime. To formalize, the management makes use of international standards such as ISO 15489 and MoReq specification. The ubiquity gained in the architecture is due to the use of intelligent agents deployed in fixed and mobile technologies: personal computers, smart phones and personal digital assistants

Management Ubiquitous of Messages and Documents Organizational through Intelligent Agents

In the context of artificial intelligence, the multiagent systems are an alternative solution to address complex problems and distributed. PAINALLI is an multi-agent architecture for managing messages and documents organizational anywhere and anytime. To formalize, the management makes use of international standards such as ISO 15489 and MoReq specification. The ubiquity gained in the architecture is due to the use of intelligent agents deployed in fixed and mobile technologies: personal computers, smart phones and personal digital assistants.In the context of artificial intelligence, the multiagent systems are an alternative solution to address complex problems and distributed. PAINALLI is an multi-agent architecture for managing messages and documents organizational anywhere and anytime. To formalize, the management makes use of international standards such as ISO 15489 and MoReq specification. The ubiquity gained in the architecture is due to the use of intelligent agents deployed in fixed and mobile technologies: personal computers, smart phones and personal digital assistants

A Simple Model of Communication APIs – Application to Dynamic Partial-order Reduction

We are interested in the verification, using model checking, of distributed programs that communicate asynchronously over standard communication APIs such as MPI. This is feasible only if the set of executions that the model checker explores is aggressively reduced to a subset of representative executions, using techniques such as dynamic partial-order reduction. We propose a small set of core primitives in terms of which such APIs can be defined and formally specify these primitives in TLA+. From this specification we derive theorems about the (in)dependence of invocations of the primitives, and use them in a DPOR-based verifier that runs within SimGrid, a simulation framework for distributed programming. Our preliminary experimental results indicate that we obtain good reductions, even though complex network operations are implemented in terms of the core commu nication primitives